Stability of Two Direct Methods for Bidiagonalization and Partial Least Squares
نویسنده
چکیده
The partial least squares (PLS) method computes a sequence of approximate solutions xk ∈ Kk(AA,A b), k = 1, 2, . . . , to the least squares problem minx ‖Ax− b‖2. If carried out to completion, the method always terminates with the pseudoinverse solution x† = A†b. Two direct PLS algorithms are analyzed. The first uses the Golub–Kahan Householder algorithm for reducing A to upper bidiagonal form. The second is the NIPALS PLS algorithm, due to Wold et al., which is based on rank-reducing orthogonal projections. The Householder algorithm is known to be mixed forward-backward stable. Numerical results are given, that support the conjecture that the NIPALS PLS algorithm shares this stability property. We draw attention to a flaw in some descriptions and implementations of this algorithm, related to a similar problem in Gram–Schmidt orthogonalization, that spoils its otherwise excellent stability. For large-scale sparse or structured problems, the iterative algorithm LSQR is an attractive alternative, provided an implementation with reorthogonalization is used.
منابع مشابه
Partial least-squares vs. Lanczos bidiagonalization - I: analysis of a projection method for multiple regression
متن کامل
Tikhonov Regularization with a Solution Constraint
Many numerical methods for the solution of linear ill-posed problems apply Tikhonov regularization. This paper presents a modification of a numerical method proposed by Golub and von Matt for quadratically constrained least-squares problems and applies it to Tikhonov regularization of large-scale linear discrete ill-posed problems. The method is based on partial Lanczos bidiagonalization and Ga...
متن کاملInexact trust region method for large sparse nonlinear least squares
The main purpose of this paper is to show that linear least squares methods based on bidiagonalization, namely the LSQR algorithm, can be used for generation of trust region path. This property is a basis for an inexact trust region method which uses the LSQR algorithm for direction determination. This method is very efficient for large sparse nonlinear least squares as it is supported by numer...
متن کاملPartial least squares- least squares- support vector machine modeling of ATR-IR as a spectrophotometric method for detection and determination of iron in pharmaceutical formulations
Iron is an essential element used as supplement in different dosage-forms. Different time and expenditure-consuming methods introduced for detection and determination of elemental ions such as atomic absorption. In this research, two different and routine methods containing ATR-IR and atomic absorption were applied to define the amount of iron in 198 samples containing different concentrations ...
متن کاملRapid and Simultaneous Determination of Montelukast, Fexofenadine and Cetirizine Using Partial Least Squares and Artificial Neural Networks Modeling
Simultaneous determination of pharmaceutical compounds and accurate quantitative prediction of them are of great interest in the clinical and laboratory-based investigations.This work has focused on a comprehensive comparison of Partial Least-Squares (PLS-1) and Artificial Neural Networks (ANN) as two powerful types of chemometric methods. For this purpose, montelukast (MONT), fexofenadine ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- SIAM J. Matrix Analysis Applications
دوره 35 شماره
صفحات -
تاریخ انتشار 2014